PATENT 

Serial No. 09/966,410 
Amendment in Reply to Office Action of September 27, 2 0 04 

IN THE CLAIMS 

Please amend claims 1, 2, 4, 17 and 20, and add claims 21-25 
as follows: 



1 1. (Currently Amended) A linear method for performing head 

2 motion estimation from facial feature data, the method comprising 

3 the steps of : 

4 obtaining a first facial image and detecting a head in said 

5 first image; 

6 detecting position of not more than four points P of said 

7 first facial image where P = (pi, P2, P3/ P4}, and pk = (xk, yk) ; 

8 obtaining a second facial image and detecting a head in said 

9 second image; 

10 detecting position of not more than four points P' of said 

11 first facial image where i^' = {p'p P2. P3, PU^i^d p\ ^ix[,y[)¥; and- 

12 determining the motion of the head represented by a rotation 

13 matrix R and translation vector T using said points P and P' . 

1 2. (Currently Amended) The linear method of claim 1, wherein 

2 said four points P of said first facial image and said four points 
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3 P' of said second facial image include locations of outer corners 

4 of each eye and mouth of each respective first and second facial 

5 images. 

1 3. (Original) The linear method of claim 1, wherein said head 

2 motion estimation is governed according to: 

"[^yLa T = [rj T^J represent camera 

4 rotation and translation respectively, said head pose estimation 

5 being a specific instance of head motion estimation. 

1 4. (Currently Amended) The linear method of claim 3 A linear 

2 method for performing head motion estimation from facial feature 

3 data, the method comprising the steps of: 

4 obtaining a first facial image and detecting a head in said 

5 first image; 

6 detecting position of four points P of said first facial image 

7 where P = {p i , P 2 , P a . P 4 }/ and P k = (x j, , y^) ; 

8 obtaining a second facial image and detecting a head in said 

9 second image; 
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10 detecting position of four points P' of said first facial 

11 image where P' = {p; , , p; , p'4 } and pi = {x[ , y[ ) ) ; and, 

12 determining the motion of the head represented by a rotation 

13 matrix R and translation vector T using said points P and , 

14 wherein said head motion estimation is governed according to: 



^ Vij ^^'^ ^ ~ ^2 ^3 r represent camera 



16 rotation and translation respectively, said head pose estimation 

17 being a specific instance of head motion estimation , and 

18 wherein said head motion estimation is governed according to 

19 said rotation matrix R, said method further comprising the steps 

20 of: 

21 determining rotation matrix R that maps points to Fk for 

22 characterizing a head pose, said points Fj,F2,F3,F4 representing three- 

23 dimensional (3-D) coordinates of the respective four points of a 

24 reference, frontal view of said facial image, and Pk is the three- 

25 dimensional (3-D) coordinates of an arbitrary point where 

26 V.^[X- Y. Z.]^ , said mapping governed according to the relation: 

27 



15 



P; = i?P. +T , where R - 
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i?(P,-P,)oc[l 0 of 
^3 /?(P,-P3)cc[0 1 of 

29 

30 wherein P5 and Pg are midpoints of respective line segments 

31 connecting points P1P2 and P3P4 and, line segment connecting points 

32 P1P2 is orthogonal to a line segment connecting points P5P6/ and 

33 °c indicates a proportionality factor. 

1 5. (Original) The linear method of claim 4, wherein 

2 components rl, r2 and r3 are computed as: 

rJ(P,-P,) = 0 
r3^(P,-P,) = 0 
r,^(P,-P3)-0 
r3'(P6-P5) = 0 



1 6. (Original) The linear method of claim 5, wherein 

2 components rl, r2 and r3 are computed as: 

3 r3=(P,-P3)x(P,-PO, 

4 

r, =r2xr3 
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7. (Original) The linear method of claim 4, wherein 



P.^ 0'' O'' 1 0 0 
0'' p.'' 0"" 0 1 0 
0'' 0^ P,'' 0 0 1 



*3 

T 



p; 



3 each point pair yielding 3 equations, whereby at least four 

4 point pairs are necessary to linearly solve for said rotation and 

5 translation. 

1 8. (Original) The linear method of claim 7, further comprising 

2 the step of: decomposing said rotation matrix R using Singular 

3 Value Decomposition (SVD) to obtain a form R = USV'^. 



1 9. (Original) The linear method of claim 7, further comprising 

2 the step of computing a new rotation matrix according to R~UV ^ 



1 10. (Original) A linear method for performing head motion 

2 estimation from facial feature data, the method comprising the 

3 steps of : 

4 obtaining image position of four points Pk of a facial image; 
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5 , determining a rotation matrix R that maps points P;c to F;^ for 

6 characterizing a head pose, said points F,,F2,F3,F4 representing 

7 three-dimensional (3-D) coordinates of the respective four points 

8 of a reference, frontal view of said facial image, and Pk is the 

9 three-dimensional (3-D) coordinates of an arbitrary point where 

P = \X Y Z V 

10 ' ^ ' ' , said mapping governed according to the relation: 

11 

i?(P,-P,)<x[l 0 of 
7?(P,-P3)oc[0 1 of 

13 

14 wherein P5 and Pg are midpoints of respective line segments 

15 connecting points P1P2 and P3P4 and, line segment connecting points 

16 P1P2 is orthogonal to a line segment connecting points P5P6/ and 

17 indicates a proportionality factor. 

1 11 . (Original) The linear method of claim 10, wherein 

2 components rl, r2 and r3 are computed as: 

r[(P,-PJ = 0 
r3^(P,-PJ = 0 
r,^(P,-P3) = 0 
r3^(P,-P3) = 0 
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12 . (Original) The linear method of claim 11, wherein 
components rl, r2 and r3 are computed as: 

r3=(P,-P5)x(P2-Pi), 

r, =r3x(P,-P.) 
r, =r2xr3 



13. (Original) The linear method of claim 12, wherein a motion 
of head points is represented according to P/ = /?P. +T 



where 



represents image rotation, T = [r, T^J 



P' 

represents translation, and denotes a 3-D image position of four 
points Pk of another facial image 



P.^ 0' 0^ 1 0 0 



0' P/ 0^ 0 1 0 
0' 0^ P' 0 0 1 



14 . (Original) The linear method of claim 13, wherein 
r 

= P' 



*3 

T 
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3 each point pair yielding 3 equations, whereby at least four 

4 point pairs are necessary to linearly solve for said rotation and 

5 translation. 

1 15 . (Original) The linear method of claim 14, further 

2 comprising the step of: decomposing said rotation matrix R using 

3 Singular Value Decomposition (SVD) to obtain a form R = USV'^. 

1 16 . (Original) The linear method of claim 15, further 

2 comprising the step of computing a new rotation matrix according to 

3 R = UV\ 

1 17 . (Currently Amended) A program storage device readable by 

2 machine, tangible embodying a program of instructions executable by 

3 the machine to perform method steps for performing head motion 

4 estimation from facial feature data, the method comprising the 

5 steps of: 

6 obtaining a_first facial image and detecting a head in said 

7 first image; 
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detecting position of not more than four points P of said 
first facial image where P = {pi, P2/ Ps/ P4}/ and Pk = (x^, Yk) ; 

obtaining a second facial image and detecting a head in said 
second image ; 

detecting position of not more than four points P' of said 
first facial image where = {p'l, P2, P3, P4} ^nd p'k = {x[ , y[) ^ ; and, 

determining the motion of the head represented by a rotation 
matrix R and translation vector T using said points P and P' . 

18 . (Original) The program storage device readable by machine 
as claimed in claim 17, wherein said four points P of said first 
facial image and four points P' of said second facial image include 
locations of outer corners of each eye and mouth of each respective 
first and second facial image, 

19 , (Original) The program storage device readable by machine 
as claimed in claim 17, wherein said head motion estimation is 
governed according to : 
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where 




and 




represent 



camera rotation and translation respectively, said head pose 
estimation being a specific instance of head motion estimation. 

20 . (Currently Amended) The A program storage device readable 
by machine ao claimed in claim 19 , tangible embodying a program of 
instructions executable by the machine to perform method steps for 
performing head motion estimation from facial feature data, the 
method comprising the steps of: 

obtaining a first facial image and detecting a head in said 
first images- 
detecting position of four points P of said first facial image 
where P = {P i , P 2 / P 3 / P 4 }/ and P k = (xk, y^) ; 

obtaining a second facial image and detecting a head in said 
second image ; 

detecting position of four points P' of said first facial 
image where P' = {pj, P2, P3. pll and p^ = (x[,y[) ; and 
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14 determining the motion of the head represented by a rotation 

15 matrix R and translation vector T using said points P and , 



16 



17 



29 



wherein said head motion estimation is governed according to: 



P; = i?P. +T_^ where 



and 



T = [r, t; tJ 



represent 



18 camera rotation and translation respectively, said head pose 

19 estimation being a specific instance of head motion estimation, and 

20 wherein said head pose estimation is governed according to 

21 said rotation matrix R, said method further comprising the steps 

22 of : 

23 determining rotation matrix R that maps points Pk to Fk for 

24 characterizing a head pose, said points Fi,F2,F3,F4 representing three- 

25 dimensional (3-D) coordinates of the respective four points of a 

26 reference, frontal view of said facial image-, and Pk is the three- 

27 dimensional (3-D) coordinates of an arbitrary point where 

28 P/=[^,- 'Z'iY i said mapping governed according to the relation: 



30 



/?(P,-PO<x[l 0 of 
7?(P,-P3)x[0 1 of 
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31 

32 wherein P5 and Pe are midpoints of respective line segments 

33 connecting points P1P2 and P3P4 and, line segment connecting points 

34 P1P2 is orthogonal to a line segment connecting points P5P6/ and 

35 ^indicates a proportionality factor. 

1 21. (New) The program storage device readable by machine as 

2 claimed in claim 20, wherein components rl, r2 and r3 are computed 

3 as : 

r[(P,-P,) = 0 
r3^(P,-P,) = 0 

^ r3^(P,-P5) = 0 

1 

1 22. (New) The program storage device readable by machine as 

2 claimed in claim 20, wherein components rl, r2 and r3 are computed 

3 as : 

r3=(P,-P5)x(P,-P,) 

r, =r3x(P,-P,) 
5 r,=r,xr. 
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1 



1 23. (New) The program storage device readable by machine as 

2 claimed in claim 20, wherein 



P.^ 0^ 0^ 10 0 
0^ Pf 0^ 0 1 0 
0^ 0^ P,^ 0 0 1 



each point pair yielding 3 equations, whereby at least four 
point pairs are necessary to linearly solve for said rotation and 
translation. 



24. (New) The program storage device readable by machine as 
claimed in claim 23, further comprising the steps of decomposing 
said rotation matrix R using Singular Value Decomposition (SVD) to 
obtain a form R = USV^ . 

25. (New) The program storage device readable by machine as 
claimed in claim 23, further comprising the steps of computing a 
new rotation matrix according to R = UV^ . 
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